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IMAGE PROCESSING METHOD 



TECHNICAL FIELD 



fOOOl] The present invention relates to the automatics and computation techniques and, 
more particularly, to methods of the preliminary image processing for sharpening and 
contrast enhancement. 

DESCRIPTION OF THE RELATED ART 
[0002] One of the methods known in the prior art is described in the Russian Patent 
No.2015561, published on 16.04.91. Int. Class G06K 9/40. According to this invention, 
the image correction is made basing on the analysis of the original image at the processed 
pixel and the local average value over some neighborhood of this pixel. 

[0003] The method of that patent smoothes the original image, thus producing the 
smoothed image containing the low frequency components presenting the image 
background. Then the smoothed image is subtracted from the original one producing the 
second image containing high frequency components without background, said second 
image is then emphasized and added to the smoothed image. 
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[0004J The disadvantage of this method is that it emphasizes not only the useful signal 
but also the noise containing in high frequency image components, thus degrading the 
quality of the enhanced image, 

[0005] The method according to U.S. Patent No.5,038,388, published on 06.08.9 U Int, 
Class G06K 9/40, smoothes the original image and subtracts the smoothed image from 
the original one thus producing the second image containing the high frequency image 
components only. The second image is then adaptively emphasized so that the larger is a 
difference between the processed pixels and its neighborhood, the higher are their scaling 
factors. The output image is produced by adding the adaptively emphasized second 
image to the original image, thus sharpening the image without the noise amplification. 

[0006] The solution disclosed in this patent does not provide any noise suppression as 
this method can only emphasize the high frequency image components that may contain a 
noise. 

[0007] Furthermore, the disadvantage of this method known in the art is that it fails to 
improve considerably the sharpness of weak edges as such enhancement requires to 
emphasize the high frequency image components in the regions where a difference 
between the processed pixel and its neighborhood is comparable to the noise level. 
Therefore, the edge enhancement in such regions causes the noise emphasis. 
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[000SJ According to the image processing method disclosed in U.S. Patent No. 
5,381,490, published on 10.01.95, Int. Class G06K 9/40, the largest difference A between 
the processed pixel and its nearest neighbors is calculated. Depending on the magnitude 
Of this difference, one of the three processing modes is selected: 

- edge enhancement by means of emphasis of the high frequency image 
components if A > T u T t presenting the first pre-defined threshold value; 

- reproduction of the original image, if T 2 < A < T t , where T 2 stands for the 
second pre-defined threshold value; 

- image smoothing to suppress a noise, if A < T2. 

[0009] The first disadvantage of this method is that it may emphasize the noise 
selectively if the difference A varies around any of the threshold values for some 
neighboring pixels thus transforming small differences between neighboring pixels into 
larger ones by involving different processing modes for these neighboring pixels. 

[0010] Furthermore, this method fails to provide quality enhancement of images with 
different noise magnitudes without tuning as the threshold values T, and T 2 are not 
selected adaptive! y. 

[0011] Another approach to the noise suppression in images is described in U.S. 
Patent 5,563,963, published on 08.10.96, Int. Class G06K 9/40. The method of this 
patent operates by selecting a plurality of groups of neighbors for each pixel of the 
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original image, each group being a square containing N x N pixels, N varying for 
example from 2 to 21. A processed pixel may be located at any position inside thi$ 
square group of pixels. The least square best fit plane (the planar approximation) is then 
used to approximate pixel values in each of selected pixel groups and the new value for 
the processed pixel and the goodness of fit are computed based on the approximation for 
each group. 

[0012] The target pixel of an enhanced image is produced by the weighted summing of 
all the new pixel values, thereat the higher is the goodness of fit for a group the higher is 
the weight of this group. 

[0013] The disadvantage of this method is that it fails to enhance edges as this method 
provides the noise smoothing only. Furthermore, this method requires substantial 
computation efforts to build least square approximations by hundreds of groups for each 
of hundreds of thousands of pixels. 

[0014] The method disclosed 'in U.S. Patent 5,739,922, published on 14.04.98, Int. 
Classes GQ6K 9/40 T H04N 1/40, operates by splitting an original color image into three 
isotropic frequency channels: low frequency image components (LF), medium frequency 
components (MF) and high frequency components (HF). Adaptive emphasis of the HF 
components and adaptive suppression of the MF components is then carried out, thereat 
the higher is the a correlation between at least two of three basic image colors the higher 
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are multipliers for HF and MF image components. The enhanced image is obtained by 
summing the LF image components with the adaptively suppressed MF components and 
the adaptively emphasized HF image components. 

[0015] The image processing method and apparatus described in that patent may have 
limited application as they are suitable for color images only since it is the correlation 
between color components only that is used for carrying out the image processing, 

[0016] Furthermore, the noise suppression according to this invention is significantly 
limited, as the HF image components, that also contain noise, may be emphasized only, 
and the noise suppression in MF image components is limited because no directional 
splitting of the original image is used. 

[0017] No edge detection and enhancement can be obtained by this method as the 
isotropic frequency channels are used. 

[0018] All these disadvantages degrade the quality of enhanced images. 

[0019] The most relevant image processing method is described in U.S. Patent No. 
5,351,305, published on 27.09.94, Int Class G06K 9/40. According to this patent, a 
plurality of directional ly filtered images is obtained from the original image by applying 
directional filters in a frequency domain. An enhanced image is then formed by selecting 
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each target pixel either from a directionally filtered image, if a contrast edge is detected 
nearby the processed pixel or from the original image otherwise. Thereat, the contrast 
edge is detected nearby the processed pixel by generating the standard deviation image 
and by producing an eigenvector description of this image. The eigenvector length is 
compared to a pre-determined threshold value to detect the edge. 

[0020] Hie target pixel is equal to the corresponding pixel of the original image, if the 
edge was not detected nearby. Otherwise, the target pixel is selected from the image 
filtered with the most nearly corresponding direction of filtering. 

[0021] While detecting edges, the eigenvector length may vary around the threshold 
value for several adjacent pixels. Whereby, the neighboring pixels of the enhanced 
image are selected from different images (the original image and directionally filtered 
image) thus causing the selective noise emphasis. This emphasis degrades the enhanced 
image quality. 



[0022] Furthermore, original images may differ in their noise levels thus requiring 
different threshold values. The method does not include adaptive selection of the 
threshold value and therefore may not provide high quality processing of images with 
different noise levels. 
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[0023] Provided that the edge is detected nearby, the selection of pixels of the 
enhanced image is made from one of the plurality of directionally filtered images thus 
causing the complete suppression of all image structures that differ by their direction 
from the detected edge, notwithstanding that those structures can be clearly seen in the 
original image. 

SUMMARY OF THE INVENTION 

[0024] The object of the claimed invention is to provide an improved method for 
enhancing the image sharpness and contrast combined with simultaneous noise 
suppression. 

[0025 J This objective according to the present invention js achieved in a image 
processing method, comprising the steps of providing an original image as a matrix of 
discreet picture elements (pixels), splitting the original image into n frequency channels, 
each of the channel being presented by an image matrix of the same size as the original 
image, detecting edges and assembling the output image from said n frequency channels 
talcing the detected edges into account, 

[0026] The step of splitting the original image is performed into a low frequency 
channel and n-1 high frequency channels and the edge detection is performed by 
computation in each of n-1 selected high frequency channels of a correlation between 

7 



PAGE 33/88 * RCVD AT 2/9/2005 1 0:09:25 PM [Eastern Standard Time] * SVR:USPTO-EFXRM/0 * DNIS:8729306 k CSID:248 594 061 0 k DURATION (mm-ss):20-54 



FEB 09 2005 10:13 PM FR RfiDER » FISHMftN 243 594 06 10 TO 9 17033729306 P . 34 

U.S. National Phase Application 

For WO00/14684 (PCT/RU99/00272) 

Serial No- 09/786,477 

Attorney Docket 65843-0001 

Clean copy of the substitute specification 

processed pixel and its neighboring pixels, followed by a comparison of the correlation 
value with that for corresponding pixels in other high frequency channels and with a «he 
threshold value for this channel. Based on the results of the comparison, weighting 
coefficients are formed for each pixel of each of the n-1 high frequency channels, and the 
assembly of the output image is made by summing each pixel from the low frequency 
channel with all products of the corresponding (by their location in the image) pixels of 
the n-1 high frequency channels by their weighting coefficients. 

[0027] The objectives of the invention is also achieved by selection of m of the n-1 
high frequency channels (2<m<=n-l) in such a way that they differ one from another in 
the direction of principal passing only, Therewithal, the weighting coefficients for any of 
the pixels of any of the m high frequency channels are defined based on the comparison 
of its correlation value to the threshold value and to the correlation values of the 
corresponding (by their location in the image) pixels of other m-I high frequency 
channels. 

[0028} The objectives of the invention is also achieved by computation of correlation 
values as a product of the processed pixel value and the weighted sum of its neighbors, 
the weights being anisotropic, the direction of this anisotropy corresponding to the 
direction of principal passing of the processed channel. 



PAGE 34/88 ' RCVD AT 2/9/2005 10:09:25 PM [Eastern Standard Time] * SVR:USPTO«EFXRM/0 ' DNIS:8729306 ' CSID:248 594 0610* DURATION (mm-ss):20-54 



FEB 09 2005 10:13 PM FR RfiDER, F I SHMflN 248 534 06 10 TO 9 17038723306 



P . 35 



U.S. National Phase Application 

For WO00/14684 (PCT/RU99/00272) 

Serial No. 09/786,477 

Attorney Docket 65843-0001 

Clean copy of the substitute specification 

[0029] Furthermore, the threshold value for any of the n-1 high frequency channels is 
determined by analysis of distribution of values, or absolute values, of pixels in this 
channel. The threshold value may be also determined by analysis of distribution of 
values, or absolute values, of pixels of the original image. 

[0030] The image processing method claimed as the invention is characterized by the 
following features that distinguish it from the most relevant method known in the prior 
art: 

1. while splitting the original image into n frequency channels, the low frequency 
channel and n-1 high frequency channels are selected; 

2. the value of cojrelation between the processed pixel and its neighboring pixels 
is used to detect edges in the image. More specifically, the value of the correlation is 
compared to the correlation values for the corresponding (by their location in the image) 
pixels in other n-1 high frequency channels and to the threshold value for this channel. 
The weighting coefficients for all pixels of the n-1 high frequency channels are generated 
as a result of this comparison; 

3. the output image is assembled by means of summing each pixel from the low 
frequency channel and all the corresponding (by their location) pixels from the n-1 high 
frequency channels multiplied by their respective weighting coefficients. 

[0031] Concerning the first feature,, it should be noted that the extraction of the low 
frequency channel that is not a subject of any processing provides the distortion-free 
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reproduction of large-scale structures of the original image in the enhanced image, as 
these objects are passed through the low frequency channel without any processing. 
Therewithal the energy of noise passing through the low frequency channel without 
suppression is inherently low as most of the noise energy is concentrated at high 
frequencies. 



r0032] Furthermore, the extraction of the low frequency channel helps reduce the 
computation power needed to find correlation values for n-1 high frequency channels, as 
the subtraction of the local average value is required to compute correlation. This 
subtraction is made while extracting (subtracting from the original image) the low 
frequency channel. 

[0033] The splitting of the original image into several high frequency channels helps 
improve, as compared to selection of one or two channels only, the noise suppression, as 
the noise associated with pixels of those frequency channels, where edges were not found 
nearby, is prevented from contributing to the enhanced image. 

[0034] Concerning the second feature, it should be noted that edge detection by means 
of the correlation value between the processed pixel and its neighbors allows to find weak 
edges against a noisy background as the correlation value is close to zero for a typical 
noise, thereat the correlation values for adjacent pixels forming the edge are positive and 
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of a similar magnitude. This difference in a correlation behavior helps achieve high noise 
suppression combined with edge emphasis thus increasing the image quality. 

[0035] The edge detection based on the correlation between a processed pixel and its 
neighbors makes the method of the present invention applicable to various types of 
images, including color and gray scale and vector images, as well as multi-dimensional 
images. Furthermore, the use of this correlation provides a quantitative measure of the 
edge intensity for each image pixel. This feature allows performing the selective 
emphasis of edges having certain intensity, for example, weak edges. 

[0036] The third specific feature, namely assembling the enhanced image by weighted 
summing images from all frequency channels, helps remove completely the effect of a 
selective noise emphasis. This effect is caused by selection of neighboring pixels from 
different frequency channels. 

[0037] Furthermore, the determination of the threshold value by means of analysis of 
statistical distribution of pixels provides a high quality processing of images with 
materially different noise magnitudes without changing parameters. 

[0038] Furthermore, the use of anisotropic frequency channels and anisotropic weights 
makes the image processing method highly sensitive to weak edges. 
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BRIEF DESCRIPTION OF DRAWINGS 

[0039] These and other features and advantages of the invention will appear from the 
following description in which a preferred embodiment has been set forth in detail in 
conjunction with the accompanying drawings of the apparatus that implements the 
claimed method, where 

[0040] Fig. 1 is a block diagram, of the apparatus. 

[0041] The preferred embodiment of the sub-units of said apparatus are shown in more 
detail at Figs. 2-5, where 

[0042] Fig.2 is a block diagram of a frequency channel splitting unit 2 of Fig. 1 
(further referred to as splitting unit); 

[0043] Fig 3 is a block diagram of one channel of a unit 3 of Fig, 1 for computation of 
correlations (further referred to as correlation unit); 

[0044] Fig.4 is a block diagram of a unit 4 of Fig. 1 for forming weighting coefficients 
(further referred to as weighting unit); 
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[0045] Fig.5 is a block diagram of the unit 5 of Fig. 1 to assemble an output image 
(further referred to as assembling unit ); 

[0046] Fig.6 shows an example of pre-defined channel selection matrixes; 
[0047] Fig.7 illustrates the operation of the splitting unit; and 

[0048] Fig.8 is a graph showing an example of the dependence of the weighting 
coefficient on the correlation value, 

DETAILED DESCRIPTION OF THE INVENTION 

[0049] Referring to Fig. 1, the apparatus contains an image source 1, an output of the 
image source being connected to an input of a splitting unit 2. A low frequency output 7 
of the splitting unit 2 is connected to an input 9 of an assembling unit 5, whereas all other 
outputs of the splitting unit 2 are connected to corresponding inputs of a correlation unit 3. 
These other outputs are also connected to inputs 10] - 10 4 of the assembling unit 5. 
Outputs of the correlation unit 3 are connected to corresponding inputs of a weighting 
unit 4, its outputs being inputs 8i - 8 4 of the assetnbling unit 5. Thereat an output of the 
assembling unit 5 is connected to an input of a memory unit 6, an output of the memory 
unit 6 being an output of the apparatus. 
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[0050] Fig.2 shows the preferred embodiment of the splitting unit 2 in more detail. 
The unit includes a direct Fourier processor 11, whose input processor is connected to the 
output of image source 1, whereas an output of the direct Fourier processor U is 
connected to first inputs of matrix multiplicators \2o - 12 4 . Second inputs of the 
mulriplicators are connected to corresponding memory units 13 c - 13 4 , the memory units 
holding pre-defined channel selection matrixes shown in Fig. 6, Any of the matrix 
multiplicators 12o - 12 4 performs an element-by-element multiplication of matrixes 
supplied to its two inputs. Outputs of the matrix multiplicators I2 0 - 12* are connected to 
inputs of inverse Fourier processors 14o - 14 4 . An output of the inverse Fourier processor 
14o is connected to the input 9 of the assembling unit 5, and outputs of the inverse Fourier 

processors I4 t - 14 4 are connected to the inputs Id - 10 4 of the assembling unit 5, as 

well as to the corresponding inputs of the correlation unit 3. 

[0051] Fig.3 shows in more detail one channel of the correlation unit 3. A memory 
unit 15 holds the image of the respective frequency channel. An input of this memory 
unit is the input of the correlation unit 3. It is connected also to input of a noise level 
measuring unit 20, an output of which unit is connected to a first input of a divider 19. A 
second input of the divider 19 is connected to an output of a multiplicator 18 whose first 
input is connected to a first output of the memory unit 15. Other outputs of the memory 
unit 15 are connected to a weighting adder 17. An output of the weighting adder is a 
second input of the multiplicator 18. An address input of the memory unit 15 is 
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connected to an address generator 16. An output of the divider 19 is the output of the 
correlation unit 3. 

[0052] The noise level measuring unit 20 may be implemented according to the U. S. 
Patent No. 5,657,401, published on 12.08.97, Int. Class G06K 9/40, which is 
incorporated herein by reference. 

[0053] All of the memory units are of the random access memory type, and DIMM 
PCI33 128Mb memory modules manufactured by IBM, or other similar ones well known 
in the art can be used for that purpose. 

[0054] The weighting adder 17 may be implemented as eight scalar multiplicators (the 
number of the multiplicators is equal to the number of adjacent pixels) and an adder. Any 
of the scalar multiplicators has two functionally identical inputs and one output. The 
outputs of all of the scalar multiplicators are connected to inputs of the adder, the output 
of the adder being the output of the unit 17. The first inputs of the scalar multiplicators 
are rhe inputs of the unit 17, and pre-defined weighting coefficients are supplied to the 
second inputs of the multiplicators. 

[0055] Fig.4 shows the weighting unit 4. The four inputs of the weighting unit 4 are 
inputs of four rounding units 23, - 23 4 , outputs of the rounding units are connected to 
inputs of an address assembling unit 24, An output of the unit 24 is connected to inputs of 
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four look-up tables 25 1 - 25 4 . The look-up table is a memory unit that stores the values 
of a weighting coefficient for any set of the four input correlation values. Outputs of the 
look-up tables 25 1 - 254. are connected to inputs of memory units 26i - 26 4 , accumulating 
values of the weighting coefficients. Address inputs of the memory units 26i - 26 4 are 
connected to an address generator 27, and outputs of the memory units 26 { - 26 4 are 
connected to inputs of adders 28, - 28 4 for averaging the weighting coefficients. Outputs 
Of the adders are the outputs of the weighting unit 4. 

[0056] Fig.5 shows the assembling unit 5. It consists of four multiplicators 29i - 29 4 
and an adder 30. The first inputs 8i - 8 4 of the multiplicators are connected to the outputs 
of the weighting unit 4, and the second inputs 10| - 10 4 of the multiplicators are 
connected to the outputs of the splitting unit 2. The outputs of the multiplicators 29 t - 
29 4 are connected to corresponding inputs of the adder 30, and, as was disclosed in the 
above, the input 9 of the adder is connected to the low frequency output 7 of the splitting 
unit 2. An output of the adder 30 is the output of the assembling unit 5, and it is 
connected to the input of the memory unit 6 that accumulates an enhanced image. 

[0057] The apparatus implements the claimed method as it is described hereinafter in 
more detail. Referring to Fig. 1, an input image is generated by the image source 1, A 
Magnetic Resonance Imaging (MRI) unit may be used, for example, as the image source 
1. This MRI unit produces an image of a cross-section of an object, this image being a 
matrix containing discreet picture elements (pixels). Hie image is carried to the input of 
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the splitting unit 2. The operation of the splitting unit 2 is described with a reference to 
Fig.2, Fig.6, and Fig.7. The input image is transformed to the frequency presentation by 
the direct Fourier processor 11. This frequency presentation contains complete 
information about the original image and is represented by the matrix of the same size as 
an input image. This matrix is passed to identical matrix multiplicators 12 0 - 124, 
performing element-by-element multiplication of the frequency presentation of the 
original image by pre-defined channel selection matrixes. The channel selection matrixes 
are stored in the memory units 13 0 - 13 4 . Each channel selection matrix contains 
multipliers for all spatial frequencies of the frequency image presentation. Fig.6 shows 
examples of the channel selection matrixes. 

[0058] More specifically, as the image is presented by a 2D matrix, its frequency 
presentation is also a 2D matrix . Fig.6a shows schematically a frequency presentation 
matrix. The horizontal and vertical spatial frequencies vary along axes k xt and k y , 
respectively. 

[0059] The zero spatial frequency corresponds to the constant image density. It is 
located at the crossing point (31) of the axes k x and k y . 

[0060] Points 32 and 33 represent the largest spatial frequency in the horizontal 
direction. The examples of images contributing to these points are shown in drawings 34 
and 35. 
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[0061] Similarly, the maximal spatial frequency in the vertical direction is located at 
points 36 and 37; the example of the image contributing to these points is illustrated by 
drawing 38. 

[0062} The maximal spatial frequencies are located at points 39 - 42. The example of 
the image contributing to these maximal spatial frequencies is shown in drawing 43. 

[0063] A medium spatial frequency in the horizontal direction is located at point 45. 
The example of the image contributing to this point is shown in drawing 44. 

[0064] The location of the spatial frequencies in drawings Fig. 6(bO corresponds to 
the scheme depicted in Fig.6a. 

[0065] Fig,6b shows schematically the pre-defined selection matrix for the low 
frequency channel, this matrix being stored in the memory unit 13 0 . 

[0066] The dark area 46 is filled by the unit values of the matrix elements. This area 
corresponds to spatial frequencies that pass through the low frequency channel. The 
white region is filled by the zero values of the matrix elements, therefore the frequencies 
of the white region do not pass through the low frequency channel. 

18 
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[0067] Fig.6(c-f) show schematically the selection matrixes for four high frequency 
channels, the same notations as in Fig.6b being used thereat. 

[0068] It should be noted that the sum of all channel selection matrixes in Fig.6(b-f) is 
the matrix with all elements equal to I. Therefore, all the infoimation from the original 
image passes through at least one channel. 

[0069] Referring now to Fig.2, each of the matrix multiplicators 12 0 - 1Z» forms on its 
output the matrix of the corresponding frequency channel in the frequency presentation. 
The inverse Fourier processors 14 0 - 14 4 transform these matrixes to the coordinate 
presentation, 

[0070] The direct Fourier processor 1 1 and inverse Fourier processors 14o - 14 4 may 
be implemented based on the Fast Fourier Transform algorithm, as described, for 
example, in: Cooley, J.M., Lewis, P.A.W. and Welch, PJD. The Finite Fourier Transform 
IEEE Trans. Audio Electroacoustics AU-17, 2, 77-86 1969. 

[0071] Fig. 7 further illustrates operation of the splitting unit. Fig. 7a shows the 
example of an input image, Figs. 7(b-f) show the images formed on the outputs of the 
inverse Fourier processors 14o - 14 4) respectively, as a result of processing the image 
shown in Fig.7a. The image of a low frequency channel 7b is carried from the output of 
the Fourier processor 14q, being the output 7 of the splitting unit 2 to the input 9 of the 
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assembly unit 5. The images of four high frequency channels are carried from the 
outputs of the Fourier processors 14 , - 14 4 > being other outputs of the splitting unit 2 7 to 
the corresponding inputs of the correlation unit 3 and to the inputs 10i - 10 4 of the 
assembly unit 5. 

[0072] The further processing of these images will be described by the example of the 
first high frequency channel as this processing is identical in all high frequency channels. 

[0073] Referring to Fig, 3, the memory unit 15 stores the partial image of the 
processed channel. To compute the unnormalized correlation value, the processed pixel 
value 21 and values of its neighboring pixels 22 are sequentially selected from the 
memory 15. These values of neighboring pixels pass to the input of weighting adder 17. 
The adder 17 implements the following operation on pixel values: 

N 

i = l 

where N is a number of pixels in neighborhood 22 of the processed pixel (preferably 
N-8), Vi are the pre-defined weighting coefficients (preferably V;=l/8) and Xj are the 
pixel values from neighborhood 22, 

[0074] Alternatively, anisotropic weights Vi can be used for computation of the 
weighted sum r of the neighboring pixels. This approach is beneficial for cases where 
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several high frequency channels differ one from another by the direction of their principal 
passing only. The direction of anisotropy of the weights Vi corresponds to the direction of 
principal passing for the processed frequency channel, 

[0075] The multjplicator 18 forms a product of the weighted sum of neighboring pixels 
and the processed pixel value. This product is the unnormalized correlation value for the 
processed pixel. It is compared to the threshold value by dividing by this threshold value 
(output of the noise level measuring unit 20) in the divider 19* The result of this division 
is compared to 1.0 in the weighting unit 4. The processing described herein is repeated 
for all of the pixels of the partial image of the processed frequency channel. 

[0076] The image of this first frequency channel passes also to the noise level 
measuring unit 20. The noise level from the output of the unit 20 is used as a threshold 
value to normalize correlation values by the divider 19, As a result, the matrix containing 
the correlation values for all of the pixels of the processed frequency channel is formed 
on the output of the correlation unit 3, these correlation values being normalized by the 
threshold value for the processed frequency channel. 

[0077] The correlation values formed by the correlation unit 3 are carried to the 
weighting unit 4. Referencing to Fig.4, those correlation values for four frequency 
channels pass to inputs of the rounding units 23 \ - 23 4 . The rounding units decrease the 
data precision to 4 or 5 bits. 
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[0078] The four rounded values from outputs of the rounding units 23i - 23 At each 
containing 4 or 5 bits, are assembled into one 16- or 20-bit word by the address 
assembling unit 24. The address formed thereby is used as an input value for the four 
look-up tables 25 1 - 25*. Each of them is a memory unit that stores values of the 
weighting coefficients for any combination of four correlation values in four frequency 
channels, such combination defining thereat the address formed by the unit 24 in a unique 
way. 

[0079] The comparison of the correlation value with correlation values for the 
corresponding pixels in other high frequency channels is performed by the look-up tables 
25i - 25 4 . The values of weighting coefficients stored in these look up tables depend on 
the con-elation values from all 4 channels, 

[0080] Fig.8 shows the preferred dependence of a weighting coefficient W t in any of 
the frequency channels on the correlation value Q in this channel and correlation values 
in other three channels, A representing the threshold value for tills frequency channel. 
The weight Wi depends on the correlation value Ci and maximal correlation value L in 
other three frequency channels. This dependence is illustrated in Fig.8 by the plurality of 
curves: 

curve A for Q > 0.7 L, 
curve B for Q = 0.5 L, 
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curve C for Q = 03 L, 
curve D for Q = 0.1 L, and 
curve E for Q = 0.01 L. 

[0081] The weighting coefficient W L takes a minimal value for correlation values that 
are significantly smaller than the threshold value A. This part of dependencies shown in 
Fig. 8 provides the noise suppression. The weighting coefficient smoothly increases from 
its minima] value to its maximal value for correlation values that are close to the 
threshold value A. Finally, the weighting coefficient takes its maximal value for 
correlation values that are significantly larger than A. This part of dependencies 
illustrated by Fig.8 provides non-distorted reproduction of edges. 

[0082] Alternatively, the weighting coefficient Wi may increases from its minimal 
value to its maximal value while the correlation value is in the range between the 
threshold value A and the second threshold value, being equal to the first threshold value 
A multiplied by some constant coefficient. The weighting coefficient Wi decreases when 
the correlation value becomes higher than the second threshold value. Therefore the 
weighting coefficient W* takes a maximum for correlation values larger than the 
threshold value A. This behavior of the weighting coefficient Wj provides the emphasis 
Of the weak edges thus improving the image quality. 
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10083] The memory units 26 1 - 264 accumulate values of the weighting coefficients 
generated by look-up tables 25 1 - 254- The address generator 27 and adders 2S\ - 284 
smooth the weighting coefficients in each frequency channel. The smoothing is obtained 
by summing in the adder (for example, 28i) the center value of the coefficient and its 
neighboring values being sequentially selected from the memory unit (for example, 26i) 
by the address generator 27. The smoothed values of the weighting coefficients formed 
on the outputs of the adders (for example, 28 1) pass to the outputs of the weighting unit 4. 

[0084] The operation of the assembling unit 5 is described with a reference to Fig. 5. 
The values of weighting coefficients for four frequency channels pass from the outputs of 
the unit 4 to the inputs 81-84 of multiplicators 29 1 - 294, whereas the pixel values of the 
corresponding frequency channels are carried from outputs of the splitting unit 2 to other 
inputs 10j - lO* of these multiplicators. The products of the pixel values by the 
corresponding weighting coefficients generated by multiplicators 29 1 - 29 4 pass to the 
inputs of the adder 30. Thereto the corresponding pixel value of the low frequency 
channel passes to the input 9 of the adder. The adder 30 adds the pixel value of the low 
frequency channel to all values of the corresponding (by their location in the image) 
pixels of the high frequency channels* the latest values are multiplied (in multiplicators 
29i - 29 4 ) by their respective weighting coefficients. The memory unit 6 accumulates 
pixels of the output image. 
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[0085] The embodiment described herein illustrates the method as applied to 2D scalar 
images. It is understood however that the claimed method may be applied similarly to 
3D images. In this case, in the apparatus used to implement the claimed method, the 
number of frequency channel increases, the 3D Fourier processors are used instead of 2D 
ones, and the number of pixels in the neighborhood of the processed pixel (used, for 
example, to compute a correlation value) is 26 instead of 8. 

[0086] The claimed method may be applied also to processing vector images, 
particularly the color images. Thereat, three components of a vector presenting a pixel 
value may correspond, for example, to the intensity of the three basic colors for this pixel. 
In this case, the scalar operations on pixel values, like Fourier transform and summing, 
are replaced by the corresponding vector operations as it is known in the art, and the 
correlation is computed as a scalar product of the center pixel value and the weighted 
vector sum of its neighbors, thereat the vector adder contains as many scalar adders as the 
number of vector components. 

[0087] For different parts of the image, different threshold values can be used to form 
weighting coefficients in at least one of the n-1 high frequency channels. When a picture 
element is represented by a scalar value, the threshold values for the different parts of the 
image and different high frequency channels are determined by analyzing distribution of 
pixel values in a corresponding part of the image of a corresponding frequency channel. 
On the other hand, when a picture element is represented by a vector, the threshold values 

25 

PAGE 51/88 * RCVD AT 2/9/2005 10:09:25 PM [Eastern Standard Time] * SVR:USPTO€FXRF-1/0 * DNIS:8729306 * CSID:248 594 061 0 * DURATION (mm«s):20-54 



FEB 09 2005 10:17 PM FR R ADER > FISHMPN 248 594 0610 TO 9 17038729306 P . 52 



U.S. National Phase Application 

For WOOO/14684 (PCT/RU99/00272) 

Serial No. 09/786,477 

Attorney Docket 65843-0001 

Clean copy of the substitute specification 

for the different parts of the image and different high frequency channels are determined 
by analyzing distribution of absolute values of vectors representing pixels in a 
corresponding part of the image of a corresponding frequency channel. 

INDUSTRIAL APPLICABILITY 
[0088] The image processing method according to the invention has the following 
advantages: 

[0089] First, the use of the correlation between the processed pixel and its neighboring 
pixels helps detect weak edges against a noisy background. This feature provides high 
noise suppression in conjunction with the emphasis of weak edges, thus significantly 
improving the image quality. Furthermore, use of correlation between the processed 
pixel and its neighbors makes the method applicable to a wide variety of image types, 
including color images, gray scale images and 3D images. 

[0090] Second, the determination of the threshold value by analysis of distribution of 
pixel values provides & high quality processing of images with the material difference in 
their noise levels without changing parameters. 

[0091] Third, the distortion-free reproduction of large-scale image structures is 
achieved due to separation of the low frequency channel. 

R02S00S8.DOC 
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IMAGE PROCESSING METHOD 
TECHNICAL FIELD 

[0001] The present invention relates to the automatics and computation techniques and, 
more particularly, to methods of the preliminary image processing for sharpening and 
contrast enhancement. 

DESCRIPTION OF THE RELATED ART BACKGROUND ART 

[0002] One of the methods known in the prior art is described in the Russian Patent 
No.2015561, published on 16.04.91, Int. Class G06K 9/40. According to this invention, 
the image correction is made basing on the analysis of the original image at the processed 
processin g pixel and the local average value over some neighborhood of this pixel. 

[0003] The method of that patent smoothes the original image, thus producing the 
smoothed image containing the low frequency components presenting the image 
background. Then the smoothed image is subtracted from the original one producing the 
second image containing high frequency components without background, said second 
image is then emphasized and added to the smoothed image. 
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[0004] The disadvantage of this method is that it emphasizes not only the useful signal 
but also the noise containing in high frequency image components, thus degrading the 
quality of the enhanced image. 

[0005] The method according to U.S. Patent No.5,038,388, published On 06.08.91, Int, 
Class G06K 9/40, smoothes the original image and subtracts the smoothed image from 
the original one thus producing the second image containing the high frequency image 
components only. The Smd second image is then adaptively emphasized so that the 
scaling factor is then higher tho H larger is a difference between the processed processing 
pixels and its neighborhoo d the higher are their scaling factors . The output image is 
produced by adding the adaptively emphasized second image to the original image, thus 
sharpening the image without the noise amplification. 

[0006] The solution disclosed described in this patent does not provide any noise 
suppression as this method can on!y emphasize the high frequency image components 
that may contain a noise. 

[0007] Furthermore, the disadvantage of this method known in the art is that it fails to 
improve considerably the sharpness of weak edges as such enhancement requires to 
emphasize the high frequency image components in the regions where a difference 
between the processed proooooing pixel and its neighborhood is comparable to the noise 
level. Therefore, the edge enhancement in such regions causes the noise emphasis. 
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[0008] According to the image processing method disclosed in U.S. Patent No, 
5,38 1,490, published on I0.0L95, Int. Class G06K 9/40, the largest difference A between 
the processed proc e ssing pixel and its nearest neighbors is calculated. Depending on the 
magnitude of this difference, one of the three processing modes is selected: 

- the edge enhancement by means of emphasis of the high frequency image 
components if A > Ti, fcere-Ti presenting pres e nts the first pre-defined threshold 
value; 

- reproduction of the original image, if T 2 < A < Tu where T 2 stands for the 
second pre-defined threshold value; 

- the image smoothing to suppress a noise, if A < T2. 

[0009] The first disadvantage of this method is that it may emphasize the noise 
selectively if the difference A varies around any of the threshold values for some 
neighboring pixels thus transforming small differences between neighboring pixels into 
Jarger ones by involving different processing modes for these neighboring pixels. 

[0010] Furthermore, this method fails to provide quality enhancement of images with 
different noi$e magnitudes without tuning as the threshold values Ti and T 2 are not 
selected adaptively. 



[0011] Another approach to the noise suppression in images is described in U.S. 
Patent 5,563,963, published on 08.10.96, Int. Class G06K 9/40. The method of this 
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patent operates by selecting a plurality of groups of neighbors for each pixel of the 
original image, each group being a square containing N x N pixels, ke*e N varying varies 
for example from 2 to 21, A processed g h e proc e ssing pixel may be located at any 
position inside this square group of pixels. The least square best fit plane (the planar 
approximation) is then used Ae» to approximate pixel values in each of selected pixel 
groups and the new value for the processed processing pixel and the goodness of fit are 
computed based basing on the said approximation for each group. 

[0012] The target pixel of an enhanced image is produced by the weighted summing of 
all the new pixel values, thereat the weight of a group is thon higher than higher is the 
goodness of fit for a this group the higher is the weight of this group . 

£0013] The disadvantage of this method is that it fails £aW$ to enhance edges as this 
method provides the noise smoothing only. Furthermore, this method requires substantial 
trage computation efforts to build least square approximations by hundreds of groups for 
each of hundreds of thousands of pixels. 

[0014] The method disclosed In U.S. Patent 5,739,922, published on 14.04,98, Int. 
Classes G06K 9/40, H04N 1/40, operates by splitting an e^the original color image into 
three isotropic frequency channels: the low frequency image components (LF), the 
medium frequency components (MF) and the high frequency components (HF). Adaptive 
The adaptive emphasis of the HF components and adaptive suppression of the MF 
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components is then carried out, thereat the multipliers for BF and MF - imago components 
arc then higher than higher is the d correlation between at least two of three basic image 
colors the higher are multipliers for HF and MF image components . The enhanced image 
is obtained by summing the LF image components with the adaptively suppressed MF 
components and the adaptively emphasized HF image components. 

[0015] The image processing method and apparatus described in jfoat sa& patent may 
have the limited application as they are suitable for color images only since it is as the 
correlation between color components only that is used for carrying out the image 
processing. 

[0016] Furthermore, the noise suppression according to this invention is significantly 
limited, as the HF image components, that also contain [aj noise, may be emphasized 
only, and the noise suppression in MF image components is limited because no 
directional splitting of the original image is used. 

[0017] No : Fhe edge detection and enhancement can net be obtained by this method as 
the isotropic frequency channels are used, 

[0018] All these disadvantages degrade the quality of enhanced images. 
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[0019] The most relevant image processing method is described in U.S. Patent No. 
5.351,305, published on 27.09.94, Int. Class G06K 9/40. According to this patent, a 
plurality of directionally filtered images is obtained from the original image by applying 
directional filters in a the frequency domain. An The enhanced image is then formed by 
selecting each target pixel either from a the directionally filtered image, if 3 tke contrast 
edge is detected nearby the processed processing pixel or from the original image 
Otherwise. Thereat, the contrast edge is detected nearby the processed processing pixel 
by generating the standard deviation image and by producing an the eigenvector 
description of this image. The eigenvector length is compared to a &e pre-determined 
threshold value to detect the an edge, 

[0020] The target pixel is equal to the corresponding pixel of the original image* if the 
edge was not detected nearby. Otherwise, the target pixel is selected from the a» image 
filtered with the most nearly corresponding direction of filtering. 

[0021] While detecting edges, the eigenvector length may vary around the threshold 
value for several adjacent pixels, Whereby. Thereby the neighboring pixels of the 
enhanced image are selected from different images (the original image and directionally 
filtered image) thus causing the selective noise emphasis. This emphasis degrades the 
enhanced image quality. 
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[0022] Furthermore, original images may differ in their noise levels thus requiring 
different threshold values. The 344$ method does not include the adaptive selection of 
the threshold value and therefore may not provide high quality processing of images with 
different noise levels. 

[0023] Provided that the edge is detected nearby, the selection of pixels of the 
enhanced image is made from one of ths plurality of directionally filtered images thus 
causing the complete suppression of all image structures that differ fay their direction 
from the detected edge, notwithstanding that those structures can be clearly seen in the 
original image* 

SUMMARY OF THE INVENTION DISCLOSURE OF INVENTION 

[0024] The object of the claimed invention is to provide [a] an improved method for 
enhancing the image sharpness and contrast combined with simultaneous noise 
suppression. 

[0025] This Tho ooid objective according to the present invention is achieved in a the 
image processing method, comprising the steps of providing an presentation of tho 
original image as a matrix of the discreet picture elements (pixeJs), splitting ef the 
original image into n frequency channels, each of the channel being presented by an 
image matrix of the same size as the original image, tho edge detection detecting edges 
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and assembling of the output image from said n frequency channels taking the detected 
edges into accountrfey ^ 

[0026] The step of splitting ef the original image is performed into a the low frequency 
channel and n-1 high frequency channels and the edge detection is performed by 
computation in each of n-I selected high frequency channels of a the correlation between 
processed proooaaing pixel and its neighboring pixels* followed by a the comparison of 
said the correlation value with that for the corresponding pixels in other high frequency 
channels and with a the threshold value for this channel. Based Basing on the results of 
the comparison, the weighting coefficients are formed for each pixel of each of the n-1 
high frequency channels, and the assembly of the output image is made by summing each 
pixel from the low frequency channel with all products of the corresponding (by their 
location in the image) pixels of the n-1 high frequency channels by their weighting 
coefficients. 

[0027] The said - obj e ctive objectives of the invention is also achieved by selection of m 
of thfi n-1 high frequency channels (2<m<=n-l) in such a way that they differ one from 
another in the direction of principal passing only. Therewithal, the weighting coefficients 
for any of the pixels of any of the m high frequency channels ana is defined based bas i n g 
on the comparison of its correlation value to die threshold value and to the correlation 
values of the corresponding (by their location in the image) pixels of other m-1 high 
frequency channels. 
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[0028] The & a i d obj e ctiv e objectives of the invention is also achieved by computation 
of said correlation values as a product of the processed processing pixel value and the 
weighted sum of its neighbors, said the weights being anisotropic^ the*eafc the direction of 
this anisotropy corresponding correspond s to the direction of principal passing of the 
processed processing channel . 

[0029] Furthermore, the threshold value for any of Jhg n-I high frequency channels is 
determined by analysis of distribution of values, or absolute values, of pixels in this 
channel. The threshold value may be also determined by analysis of distribution of 
values, or absolute values, of pixels of the original image, 

[0030] The claimcd - as the invention image processing method claimed as the invention is 
characterized by the following features that distinguish it from the most relevant method 
known in the prior art: 

1. while splitting the original image into n frequency channels, the low frequency 
channel and n-1 high frequency channels are selected; 

2. the value of correlation between the processed processing pixel and its 
neighboring pixels is used to detect edges in the image. More specifically, the value of 
thg correlation is compared to the correlation values for the corresponding (by their 
location in the image) pixels in other n-1 high frequency channels and to the threshold 
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value for this channel. The weighting coefficients for all pixels of the n-1 high frequency 
channels are generated as a result of this comparison^ t 

3. the output image is assembled by means of summing e§ each pixel from the low 
frequency channel and all the corresponding (by their location) pixels from the. n-1 high 
frequency channels multiplied by their respective weighting coefficients. 

[0031] Concerning the first feature A it should be noted that the extraction of the low 
frequency channel that is not a subject of any processing provides the distortion free 
distortion-free reproduction of large-scale structures objects of the original image in the 
enhanced image, as these objects are passed through the low frequency channel without 
any processing. Therewithal the energy of noise passing through the low frequency 
channel without suppression is inherently low as most of the noise energy is concentrated 
at high frequencies. 

[0032] Furthermore, the extraction of the low frequency channel helps reduce the 
computation power offorta needed to find coiTelation values for n-1 high frequency 
channels, as the subtraction of the local average value is required to compute correlation. 
This subtraction is made while extracting (subtracting from the original image) the low 
frequency channel. 

[0033] The splitting of the original image into several high frequency channels helps 
improve, as compared to selection of one or two channels only , the noise suppression, as 
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the « noise associated with pixels of those frequency channels, where edges were not 
found nearby, is prevented from contributing to the enhanced image. 

[0034] Concerning the second feature^ it should be noted that edge detection by means 
of the correlation value between the processed processing pixel and its neighbors allows 
to find weak edges against a noisy background as the correlation value is close to zero 
for a the typical noise, thereat the correlation values for adjacent pixels forming the edge 
are positive and of a similar magnitude. This difference in a correlation behavior helps 
achieve tfee high noise suppression combined with edge emphasis thus increasing the 
image quality sharpness and contrast . 

[0035] The edge detection based basing on the correlation between a processed 
procosoing pixel and its neighbors makes the method of the present invention applicable 
to various types of images, including color an d gray scale and vector images^ as well as 
multi-dimensional images. Furthe r more, the use of this correlation provides a 
quantitative measure of the edge intensity for each image pixel. This feature allows 
performing the selective emphasis of edges having certain intensity, for example, the 
weak edges. Furthermore, una nf thr > nnn-ni.nHnn h"t"'ecn the pi jic l and i trj ne igh bors 
makeo tho method of the present invanrinT! nppiirnhi* vflripuj typec of ima^cc, 
including, for cicamplQ, color and gray scale images, as well ao throe dimenoional 
imagos r 
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[0036] The third specific feature, namely assembling the enhanced image by 
weighted summing ef images from all frequency channels, helps remove completely 
the effect of & the selective noise emphasis. This effect is caused by selection of 
neighboring pixels from different frequency channels. 

[0037] Furthermore, the determination of the threshold value by means of analysis of 
statistical distribution of pixels provides a high quality processing of images with 
materially different noise magnitudes without changing parameters. 

[0038] Furthermore, the use of anisotropic frequency channels and anisotropic weights 
makes the image processing method highly sensitive to weak edges. 

BRIEF DESCRIPTION OF DRAWINGS 

C0039J These and other featur es and advantages of the invention will appear from the 
following description in whi ch a preferred embodiment has been set forth in derail in 
conjunction with the accompanying drawings o f the apparatus that imp lements the 
claimed method, where The claimod invention is illustrated by the drawings of tho 
apparatus that implcmonto the claimod method. 

[0040] Fig. 1 is a block diagram, of the apparatus. 
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[0041] The preferred embodiment of the sub-units of said apparatus are shown in more 
detail detfttte at Figs. 2-5, where Fig. 2 5. 

[0042] Fig.2 is a block diagram of a &e frequency channel splitting unit 2 of Fig. 1 
(further referred to as splitting unit); 

[0043] Fig.3 is a block diagram of one channel of a the unit 3 of Fig. 1 for computation 
of correlations (further referred to as correlation unit); 

[0044] Fig.4 is a block diagram of a the unit 4 of Fig. 1 for forming of the weighting 
coefficients (further referred to as weighting unit); 

[0045] Fig.5 is a block diagram of the unit 5_of Fig. 1 to assemble an the output image 
(further referred to as assembling unit ); 

[0046] Fig,6 shows an example of the pre-defined channel selection matrixes; 

[0047] Fig.7 illustrates the operation of the frequency channel splitting unit; and 

[0048] Fig.8 is a graph showing an example of the dependence of the weighting 
coefficient on the cotrelation value. 
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DETAILED DESCRIPTION OF THE INVENTION 

[0049] Referring to Fig. 1, the apparatus contains gn t*»e image source 1, an the output 
of the said image source being connected to an the input of a the splitting unit 2, A The 
low frequency output 7 of the splitting said unit 2 is connected to an the input 9 of an the 
assembling unit 5, whereas ail other outputs of the said splitting unit 2 are connected to 
the corresponding inputs of & the correlation unit 3. These said other outputs are also 
connected to the inputs 10i - IO4 of the assembling unit 5. Outputs of the The outputs of 
said correlation unit 3 are connected to the corresponding inputs of a the- weighting unit 4, 
its the outputs bejng of ooid weighting unit arc the inputs 81 - 84 of the assembling unit 5. 
Thereat an the output of the. aaid assembling unit 5 is connected to an the input of a the 
memory unit 6, an the output of the said memory unit 6 being « an output of the 
apparatus. 

[0050] Fig.2 shows moro in details the preferred embodiment of the splitting unit 2 in 
more detail. The unit it includes £ the direct Fourier processor 11, whose the input ef 
said processor is connected to the output of image source 1, whereas an the output of the 
said direct Fourier processor 11 is connected to the first inputs of matrix multiplicators 
12o - 124. The socond Second inputs of the said multiplicators are connected to the 
corresponding memory units 13n - 13*. the said memory units holding hold the pre- 
defined channel selection matrixes shown ip illustrated at Fig. 6. Any of the matrix 
multiplicators 12 0 - 124 performs an the element-by-element multiplication of matrixes 
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supplied to its two inputs. Outputs of the Tho output a of said matrix multiplicators 12 0 - 
12 4 are connected to the inputs of the inverse Fourier processors 14q - I4 4 . An output 
Tho output of the inverse Fourier processor 14o is connected to the input 9 of the 
assembling unit 5, and outputs of the inverse Fourier processors 14 j — 14 4 are connected 
to the inputs 10i - 10 4 of the assembling unit 5. as well as to the corresponding inputs of 
the correlation unit 3. 

[0051] Fig.3 shows in more d e tail one channel of m or e in detail s the correlation unit 3. 
A The memory unit 15 holds the image of the respective processin g frequency channel. 
An The input of this sak* memory unit is the input of the correlation unit 3, It is 
connected also to the input of a the noise level measuring unit 20, an the output of which 
said unit is connected to a the first input of a divider 19. A The second input of the sa*4 
divider 19 is connected to an the output of a multiplicator 18 . Tho whose first input ef 
said multiplicator is connected to a the first output of the memory unit 15. Other outputs 
of the said memory unit 15 are connected to a the weighting adder a ummator 17 . An , the 
output of the said weighting adder aummator is a the second input of the multiplicator 18. 
An The address input of the memory unit 15 is connected to an the address generator 16. 
An The output of the divider 19 is the output of the correlation unit 3. 

[0052] The noise level measuring unit 20 may be implemented according to the IL S, 
Patent No. 5,657,401, published on 12.08.97, Int. Class G06K 9/4 0, which is 
incorporated herein by reference . 
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[0053] All of the memory units are of the random access memory type^and DIMM 
PCI 33 128Mb memory modules manufactured bv IBM, or other similar ones they-are 
well known in the art can be used for that purpose . 



[0054] The weighting adder summntor 17 may be implemented as eight scalar 
multiplicators (the number of the said multiplicators is equal to the number of adjacent 
pixels) and an adder. Any of Shs. said scalar multiplicators has two functionally identical 
e^*al inputs and one output. The outputs of all of the scalar said- multiplicators are 
connected to the inputs of the adder, ouramotor , the output of the adder he. hp said 
oummator4s the output of fljg unit 17. The first inputs of the scalar said multiplicators are 
the inputs of the unit 17, and the pre-defined weighting coefficients are supplied to the 
second inputs of the said multiplicators. 



[0055] Fig.4 shows the weighting unit 4. The four inputs of the weighting unit 4 are 
the inputs of four rounding units 23, - 23 4 , the outputs of the said rounding units are 
connected to (he inputs of an the address assembling unit 24. An The output of the. said 
unit 24 is connected to inputs of four look-up tables 25, - 25 4 . The look-up table is a 
memory unit that stores the values of a. the weighting coefficient for any set of the four 
input correlation values. Outputs The outputa of the look-up tables 25, - 25 4 are 
connected to the inputs of the memory units 26, - 26*. accumulatin g paid memory unto 
accumulate values of the weighting coefficients. Address The address inputs of the 
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memory units 26i - 26 4 are connected to an the address generator 27, and *fee outputs of 
the said memory units 26 T - 26 £ are connected to *e inputs of adders summators 28 1 - 
28 4 for averaging the of weighting coefficients. Outputs Tho outputs of the adders said 
summators are the outputs of the weighting unit 4. 

[0056] Fig.5 shows the assembling unit 5, It consists of four multiplicators 29! - 2% 
and an adder Gammator 30. The first inputs Sj - 8 4 of the said multiplicators are 
connected to the outputs of the weighting unit 4, and the second inputs 10 t - 10 4 of the. 

multiplicators are connected to the outputs of the splitting unit 2. The outputs of die 
multipJicators 29 x - 29 4 are connected to the corresponding inputs of the adder summator 
30, and, as was disclosed in the above,, the input 9 of the adder said summator is 
connected to the low frequency output 7 of the splitting unit 2. An The output of the 
adder summator 30 is the output o f the assembling unit 5. and it is connected to the input 
of the memory unit 6 that accumulates an enhanced image. 

BEST MOPE FOR CARRYING OUT THE IEfVENTION 



in 



[0057] The apparatus implements the claimed method as it is described hereinafter _ 
more deta il. Referring to Fig. 1, an the input image is generated by the image source 1. A 
Magnetic Resonance Imagins fM^T) Tho MRI unit may be used, for example, as the 
Image source 1. This MRI unit produces ail the image of a the cross-section of an 
object, this image being a matrix containing discreet picture elements (pixels). The Said 
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image is carried to the input of the splitting unit 2. The operation of the splitting unit 2 is 
described with a reference to Fis.2. Fig.6. and Fig.7. The input image is transformed to 
the frequency presentation by the direct Fourier processor 11. This Sate frequency 
presentation contains *he complete information about the original image and is 
represented by the matrix of the same size as an input image. This matrix is passed to 
identical matrix multiplicators 12 0 - 124, thoao matrix multiplicators perform the 
performing element-by-element multiplication of the frequency presentation of the 
original image by pre-defined channel selection matrixes. Thg Saw* channel selection 
matrixes are stored in the memory units 13 0 - 13*. Each channel selection matrix 
contains the multipliers for all spatial frequencies of the frequency image presentation. 
Fig.6 shows the examples of the channel selection matrixes. 

[0058] More specifically, as the, tm image is presented by a 2D matrix, its frequency 
presentation is also a 2D matrix . Fig.6a shows schematically a frequency presentation 
matrix. The horizontal and vertical spatial frequencies vary along axes k x , and k y , 
respectively. 

[0059] The zero spatial frequency corresponds to the constant image density. It is 
located at the crossing point (31) of the axes k x and k y . 
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[0060] Points 32 and 33 represent the largest spatial frequency in the horizontal 
direction. The examples of images contributing to these points are shown in drawings 34 
and 35. 

[0061] Similarly, the maximal spatial frequency in the vertical direction is located at 
points 36 and 37; the example of the image contributing to these points is illustrated by 
drawing 38. 

[0062] The maximal spatial frequencies are located at points 39 - 42. The example of 
the a» image contributing to these maximal spatial frequencies is shown in drawing 43. 

[0063] A medium, Modium spatial frequency in the horizontal direction is located at 
point 45. The example of the image contributing to this point is shown in drawing 44. 

[0064] The location of the spatial frequencies in drawings Fig. 6(b~f) corresponds to 
the scheme depicted in Fig.6a. 

[0065] Fig.6b shows schematically the pre-defined selection matrix for the low 
frequency channel, this said matrix being stored in the memory unit 1 3<>. 

[0066] The dark area 46 is filled by the unit values of the matrix elements. This area 
corresponds to spatial frequencies that pass through the low frequency channel. The 
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white region is filled by the zero values of the matrix elements, therefore the frequencies 
of the white region do not pass through the low frequency channel, 

[0067] Fig,6(c-f) show schematically the selection matrixes for four high frequency 
channels, thereat the same notations as in Fig.6b being used thereat are uacd . 

[0068] It should be noted that the sum of all channel selection matrixes in F1g.6(b-f) is 
the matrix with all elements equal to 1. Therefore^ all the information from the original 
image passes through at least one channel. 

[0069] Referring now to Fig.2, each of the matrix multiplicators 12 0 - 12* forms on its 
output the matrix of the corresponding frequency channel in the frequency presentation. 
The inverse Fourier processors 14 0 - 14 4 transform these said matrixes to the coordinate 
presentation. 

[0070] The direct Fourier processor 1 1 and inverse Fourier processors 14o - 14 4 may 
be implemented based baaing on the Fast Fourier Transform algorithm, as described, for 
example, in: Cooley, J.M., Lewis, RA/W. and Welch, P.D> (1969) The The Finite 
Fourier Transform finito Fourier transform, I.E.E.R Trans. Audio Electroacoustics AU- 
17, 2, 77-86 1969 . 
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[0071] Fig. 7 further illustrates operation of the splitting unit. Fig. 7a shows the 
example of an input image, figr Figs. 7(b-f) show the images formed on the outputs of 
the inverse Fourier processors 14 0 - 14 4 , respectively, as a result of processing ef the 
image shown in Fig,7a. The image of a low frequency channel 7b is carried from the 
output of the Fourier processor 14^ being the output 7 of the splitting unit 2 to the input 9 
of the assembly unit 5. The images of four high frequency channels are carried from the 
outputs of the Fourier processors 14! - 14 4) being other another outputs of the splitting 
unit 2 7 to the corresponding inputs of the correlation unit 3 and to the inputs I0 t - 10 4 of 
the assembly unit 5. 

[0072] The further processing of these images will be described by the e» example of 
the first eae high frequency channel as this «ai<i processing is identical in all high 
frequency channels. 

[0073] Refeming to Fig. 3, the memory unit 15 stores the partial image of the 
proceed 1 processing channel. To compute the unnormalized correlation value, the 
processed oontcr pixel value 21 and values of its neighboring pixels 22 are sequentially 
selected from the memory 15. These Said values of neighboring pixels pass to the input 
of weighting adder svem&tet 17 . The adder 17, nmd nnmmn^ implements the following 
operation on pixel values: 
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N 

r = ZViXi 
i = l 

where N is a number of pixels in neighborhood 22 of the processed central pixel 
(preferably N=8), Vj are the pre-defined weighting coefficients (preferably Vi=l/8) and 
Xj are the pixel values from neighborhood 22. 

[0074] Alternativ ely, anisotropic weights V; can be used for computation of the 
weighted sum r of the neighboring p ixels. This approach is beneficial for cases where 
several high frequenc y channels differ one from another bv the direction of their principal 
passing only. The directio n of anisotropy of the weights V; corresponds to the direction of 
principal passing for the processed frequency channel. 

[0075] The multiplicator 18 forms a product of the weighted sum of neighboring pixels 
and the processed central pixel value. This product is the unnormalized correlation value 
for the processed processing pixel. It is compared to the threshold value by dividing by 
this said threshold value (output of the noise level measuring unit moan s 20) in tfae 
divider 19. The result of this emd division is compared to 1.0 in the weighting unit 4. 
The processing described herein i$ repeated for all of the pixels of the partial image of the 
processed proce s s i ng frequency channel, 
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[0076] The image of this first frequency channel passes also to the noise level 
measuring unit moans 20. The noise level from the output of the unit moans 20 is used as 
a threshold value to normalize correlation values by the divider 19, As a result, the 
matrix containing the correlation values for all of the pixels of the processed processing 
frequency channel is formed on tfce output of the correlation unit 3, these said correlation 
values being normalized by the threshold value for the processed processing frequency 
channeL 



[0077] The correlation values formed by the correlation unit 3 are carried to the 
weighting unit 4, Referencing to Fig.4, those said correlation values for four frequency 
channels pass to inputs of the rounding units me^ro 23t - 23 4 . The Said rounding units 
Cl e ans decrease the data precision to 4 or 5 bits. 



[0078] The four rounded values from outputs of the rounding unite maa^ 23i - 23 4 , 
each containing 4 or 5 bits, are assembled into one 16- or 20-bit word by the address 
assembling unit 24. The formed address formed thereby j s used as an input value for the 
four lookup, leek-ap tables 25 x - 25 4 . Each of them auid loolc up tablu, is a memory unit 
that stores values of the weighting coefficients for any combination of four correlation 
values in four frequency channels, theiert such combination defining thereat defines the 
address formed by the unit 24 in a unique way. 
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[0079] The comparison of the correlat ion value with correlation values for the 
corresponding pixels in other hig h frequency channels is performed bv the look-up tables 
2 5\ • 25^ The values of weighting coefficients stored in these look up tables depend on 
the correlation values fr om all 4 channels. 

[0080] Fig.8 shows the preferred dependence of a the weighting coefficient W L in any 
of the frequency channels on the correlation value Q in this channel and correlation 
values in other three channels, wher e A stands for representing the threshold value for 
tills frequency channel. The weight Wi depends on the correlation value Ci and maximal 
correlation value L in other three frequency channels. This dependence is illustrated in at 
Fig.8 by the plurality of curves: 

curve A for Ci > 0.7 L, 

curve B for Q = 0.5 L, 

curve C for Q = 0.3 L, 

curve D for Ci = 0. 1 L, and 

curve E for Q = 0.01 L. 



C00S13 The weighting coefficient W; takes a min imal value for correlation values tn?t 
are significantly smaller than the thre shold value A. This part of dependencies shown in 
Fig.8 proves the noise suppression. The weighting co e fficient smoothly increase frnm 
its minimal value to its maxima! value for corre lation values that are close to the 
th reshold value A. Finally, thfi weighti ng coefficient takes its maximal value for 
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correlation values that are significantly larger than A. This part of dependencies 
illustrated bv Fig.8 provides non-distorted reproduction of edges. 

[0082] Alternatively, the w eighting coefficient W ; mav increases from its minimal 
value to its ma ximal value while the correlation value is in the range between the 
threshold value A a nd the second threshold value, being equal to the first threshold value 
A multiplied bv some consta nt coefficient. The weighting coefficient W^decreases when 
the corre lation value becomes higher than the second threshold value. Therefore the 
weighting coefficient W ; take s a maximum for correlation values larger than the 
threshold value A. This behavior o f the weighting coefficient W; provides the emp hasis 
of the weak edges th us improving the image quality. 

£0083] The memory units 26i - 264 accumulate values of the weighting coefficients 
generated by look-up le ak up tables 25, - 25 4 . The address generator 27 and adders 
summators 28 1 - 28* smooth tfie said weighting coefficients in each frequency channel. 
The smoothing is obtained by summing in the adder summator (for example, 28i) 
the center value of the coefficient and its neighboring values being sequentially selected 
from the memory unit (for example, 26i) by the address generator 27, The smoothed 
values of tihe weighting coefficients formed on the outputs of the adders flummatnrs (for 
example* 28 0 pass to the outputs of the weighting unit 4, 
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[0084] The operation of the assembling unit 1 is described with a reference to Fig. 5. 
The values of weighting coefficients for four frequency channels pass from the outputs of 
the unit 4 to the inputs 8i - 8 4 of muitiplicators 29 1 - 29 4 ea4 ^whereas the pixel values 
of the corresponding frequency channels are carried from outputs of the splitting unit 2 to 
other another inputs 10i - 1CU of these muitiplicators. The products of the sai3 pixel 
values by the corresponding weighting coefficients generated by muitiplicators 29i - 29* 
pass to the inputs of the adder flummator 30. Thereto the corresponding pixel value of the 
low frequency channel passes to the input 9 of the adder said oummator . The adder 30 
adds the pixel value of the low frequency channel to all values of the corresponding fbv 
their location in the imaged pixe ls of the high frequency channels, the latest values are 
multiplied (in muitiplicators 29^ - 29 A ) bv their respective weighting coefficients. The 
memory unit 6 accumulates pix els of the output ima^ . Th e reby the summator 30 
e mulates the value of the target - pixel of tho output image, said pixclo euro accumulated in 
the memory unit 6. 

[0085] The embodiment described herein illustrates the method as applied to 2D scalar 
images, ft is understood however that the claimed method may be applied similarly to 
3D images. In this case, in the apparatus used to implement the claimed method, the 
number of frequency channel increases, the 3D Fourier processors are used instead of 2D 
ones, and the number of neighborin g pixels in the neighb orhood of the processed pixel 
(used, for example, to compute a correlation value) is 26 instead of 8- 
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[0086] The claimed method may be applied also to processing ^f vector images, 
particularly the color images. Thereat, the^S three components of a vector presenting a 
pixel value may correspond, for example, to the intensity of the three £ basic colors for 
this pixel. In this case, the scalar operations on pixel values, like Fourier transform and 
summing, are replaced by the corresponding vector operations as it is known in the art, 
and the correlation is computed as a scalar product of the center pixel value and the 
weighted vector sum of its neighbors, thereat the vector adder summator contains as 
many scalar adders sum motors as the number of vector components. 

t°°87] For different parts of the image, diffe rent threshold values can be used to form 
weighting coefficients in at least one of the n-1 high frequency channels. When a picture 
element is represented by a scalar value, the threshold values for the different carts of the 
image and different high frequenc y channels are determined fay analyzing distribution of 
pixel values in q corresponding part of the image o f a corresponding frequency channel- 
On the other hand, when a picture element i s represented bv a vector, the threshold values 
far- the different part* of the image and different high frequency channels are determined 
by analyzing distribution of abs olute values of vectors representing pixels in a 
corresponding part o f the image of a corresponding frequency channel 

INDUSTRIAL APPLICABILITY 
[0088] The image processing method according to the invention has the following 
advantages: 
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[0089] First, the use of the correlation between the processed prooossing pixel and its 
neighboring pixels helps detect weak edges against a noisy background. This feature 
provides high noise suppression in conjunction with the emphasis of weak edges, thus 
significantly improving the image quality. Furthermore, use of correlation between the 
processed processing pixel and its neighbors makes the method applicable to a wide 
variety of image types, including color images, gray scale images and 3D images. 

[0090] Second, the determination of the threshold value by analysis of distribution of 
pixel values provides a high quality processing of images with the material difference in 
their noise levels without changing of parameters. 

[0091] Third, the distortion-free reproduction of the large-scale image structures is 
achieved due to the separation of the low frequency channel. 
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